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Parrondo's games manifest the apparent paradox where losing strategies can be 
combined to win and have generated significant multidisciplinary interest in the lit- 
erature. Here we review two recent approaches, based on the Fokker-Planck equa- 
tion, that rigorously establish the connection between Parrondo's games and a 
physical model known as the flashing Brownian ratchet. This gives rise to a new set 
of Parrondo's games, of which the original games are a special case. For the first 
time, we perform a complete analysis of the new games via a discrete-time Markov 
chain (DTMC) analysis, producing winning rate equations and an exploration of 
the parameter space where the paradoxical behaviour occurs. 
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1. Introduction 

In many physical and biological systems, combining processes may lead to counter- 
intuitive dynamics. For example, in control theory, the combination of two unstable 
systems can cause them to become stable (Allison & Abbott 2001a). In the theory 
of granular flow, drift can occur in a counter-intuitive direction (Rosato et at 1987; 
Kestenbaum 1997). Also the switching between two transient diffusion processes in 
random media can form a positive recurrent process (Pinsky & Scheutzow 1992). 
Other interesting phenomena where physical processes drift in a counter-intuitive 
direction can be found (see for example Adjari & Prost 1993; Maslov & Zhang 1998; 
Westerhoff et al. 1986; Key 1987; Abbott 2001). 

The Parrondo's paradox (Harmer & Abbott 1999a, b; Harmer et al. 2000) is 
based on the combination of two negatively biased games - losing games - which 
when combined give rise to a positively biased game, that is, we obtain a win- 
ning game. This paradox is a translation of the physical model of the Brownian 
ratchet into game-theoretic terms. These games were first devised in 1996 by the 
Spanish physicist Juan M. R. Parrondo, who presented them in unpublished form 
in Torino, Italy (Parrondo 1996). They served as a pedagogical illustration of the 
flashing ratchet, where directed motion is obtained from the random or periodic al- 
ternation of two relaxation potentials acting on a Brownian particle, none of which 
individually produce any net flux (see Reimann 2002 for a complete review on 
ratchets). 
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These games have attracted much interest in other fields, for example quantum 
information theory (Abbott et al. 2002; Flitney et al. 2002; Meyer & Blumer 2002a; 
Lee et al. 2002a), control theory (Kocarev & Tasev 2002; Dinis & Parrondo 2002), 
Ising systems (Moraal 2000), pattern formation (Buccta et al. 2002a, b; Buceta & 
Lindenberg 2002), stochastic resonance (Allison & Abbott 2001b), random walks 
and diffusions (Cleuren & Van den Broeck 2002; Key et al. 2002; Kindcrlchrcr 
& Kowalczyk 2002; Percus & Percus 2002; Pyke 2002), economics (Boman et al. 
2002), molecular motors in biology (Ait-Haddou & Herzog 2002; Heath et al. 2002) 
and biogenesis (Davies 2001). They have also been considered as quasi-birth-death 
processes (Latouche & Taylor 2003) and lattice gas automata (Meyer & Blumer 
2002b). 

Parrondo's two original games are as follows. Game A is a simple tossing coin 
game, where a player increases (decreases) his capital in one unit if heads (tails) 
show up. The probability of winning is denoted by p and the probability of losing 
is 1 — p. 

Game B is a capital dependent game, where the probability of winning depends 
upon the actual capital of the player, modulo a given integer M. Therefore if the 
capital is i the probability of winning -Ki is taken from the set {7To,7ri, . . . ,7Tm-i} 
as TTi ~ 7ri moc j m- In the original version of game B, the number M is set equal to 
three and the probability of winning can take only two values, p\, p 2 , according 
to whether the capital of the player is a multiple of three or not, respectively. 
Using the previous notation we have p\ = ttq , p 2 = tt± = tt2 ■ The numerical values 
corresponding to the original Parrondo's games (Harmer & Abbott 1999a) are: 



where e is a small biasing parameter introduced to control the three probabilities. 

Although the original game B was based on a modulo rule, there are other 
versions of Parrondo's games where this rule has been replaced by a history de- 
pendent rule (Parrondo et al. 2000); also combinations of two history dependent 
games are considered (Kay & Johnson 2002). Instead of a random alternation, also 
chaotic alternation between the games has been studied (Arena et al. 2003). Ef- 
fects of cooperation between players have also been considered in Parrondo's games, 
where the probabilities of game B depend on the actual state of the neighbours of 
the player (Toral 2001), also a redistribution of capital between the players has 
been considered (Toral 2002). Other variations of collective games have recently 
appeared (Mihailovic & Rajkovic 2003a, b). For a full review of Parrondo's paradox 
see Harmer & Abbott 2002. 

Games A and B appearing in the Parrondo's paradox can be thought of as 
diffusion processes under the action of a external potential. However, they do not 
have the more general form of a natural diffusion proces, because the capital will 
always change with every game played, whereas in the most general diffusion process 
a particle can either move up or down or remain in the same position at a given time. 
In this article we present a new version of Parrondo's games, where a new transition 
probability is taken into account. We introduce a self-transition probability, that 
is, the capital of the player now can remain the same after a game played with a 
probability pi, taken from the set {po,Pi, ■ ■ ■ ,Pm-i} as p, = PimodM- Again, for 
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simplicity, we will only consider the case of M = 3 with just two possible self- 
transition probabilities, n, r 2 , depending only on the capital being a multiple of 
three or not: T\ = po, r 2 = p\ = p2- 

As we will show, the significance of this new version is a natural evolution of 
Parrondo's games, which can now be rigorously derived from the Fokker-Planck 
equation, based on a physical flashing ratchet model. 

The outline of this paper is as follows. In section 2 we briefly review two relations 
concerning Parrondo's games and the Fokker-Planck equation. In both relations it is 
straightforward the inclusion of self-probabilities. In Sec. 3 we give a mathematical 
analysis of the new games using discrete-time Markov chains and derive conditions 
for the paradox to appear. In Sec. 4 we calculate the rates of winning, describe the 
parameter space and present numerical simulations which confirm and extend the 
theoretical analysis. Finally, in section 5 we provide a brief discussion of the results. 



2. The Flashing ratchet and the Fokker-Planck equation 

Despite the fact that Parrondo's paradox was inspired by the flashing ratchet, the 
relation between both has only been made quantitative recently, when two different 
approaches have established a formal relation between Parrondo's games and the 
physical model of the flashing ratchet (Allison & Abbott 2002 and Toral et al. 
2003a). We now very briefly review both approaches. 

In the scheme proposed by Allison & Abbott (2002), the starting point is the 
following general Fokker-Planck equation (see Horsthemke and Lefever, 1984), for 
the probability P(x, t) of a Brownian particle moving in a time-dependent one- 
dimensional potential V(x,t): 

D d 2 P p da ^dP dP _ Q 
dx 2 dx dx dt 

where a and D are referred to as the infinitesimal first and second moments of 
diffusion, respectively; D has a constant value - "Fick's law constant"- while a(x, t) 
is a function related to the applied potential V(x, t) by the equation 

a(x,t) = -u^-V{x,t), (2.2) 

where u denotes the mobility of the Brownian particle. 

Then (2.1) is discretized using a finite difference approximation obtaining 



where 



Pi,j — al\ ■ Pi-\,j-i + a l Q J ■ P%,j—i + a+i ■ Pi+ij-i (2-3) 

(2.4) 



-1 a {i + l,j-l)-a(i-l,j-l) ^ | -i 

a 3 = a (i + i,j-i)- a (i-i,j-i) ( 2 - 5 ) 
2A T ~r 1 

Dt _ a(i,j)T 

J,j _ 1^ 2A 

+ 1 a(»+l,j-l)-a(i-l,j-l) , , 1 • 
2A T ~r 1 



(2.6) 
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Here the index i denotes the discrctized space x — iX, whereas j denotes the 
discrctized time t = jr ; A and r account for the space and time discretization steps 
respectively. 

This discretized form (2.3) of the Fokker-Planck equation is compared to the 
master equation for any of the gambling games used in Parrondo's paradox 

Pi,j = Ti-i • Pi-ij-i + Pi ■ Pi,j-i + (1 - - Pi+i) ■ Pi+ij-i (2.7) 

where Pij denotes the probability that the player has a capital i at the j play. In 
the original Parrondo games the self-transition probability is zero, so that the term 
Pi is set to zero in the following calculations. 
Combining (2.3) and (2.7) we get 



and it follows that the function a(i,j) =on is independent of the time index j: 

A 7Tj_i + (1 - 7Tj + l) 

Finally the discretized values of the potential are obtained combining (2.2) with 
(2.9),' 

i i-( k^±l) 

This equation allows one to obtain the discretized version of the physical potential 
Vj in terms of the probabilities iri of the games. 

A second relation between the Fokker-Planck equation and the master equation 
has been proposed by Toral et al. (2003a). Unlike the first approach described above 
now the starting point is not the Fokker-Planck equation but rather the rewriting 
of the master equation (2.7) in the form of a continuity equation for the probability: 

Pi,j ~ Pi,j-i = _ [Ji+i,j ~ Ji,j] ( 2 -ll) 
where the current Jij is given by: 

Jij - \ [PiPij + F^P^] - [DiPij - ^ (2.12) 

and 

Fi = 27r, + Pi - 1, Di = . (2.13) 

These coefficients can be related with their analogous terms corresponding to a 
discretization of the Fokker-Planck equation for a probability P(x, t) 

dP(x,t) _ dJ(x,t) 
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with a current 

J(x,t) = F(x)P{x,t) - 
for a general drift F(x) and diffusion D{x). 



d[D{x)P{x,t)] 
dx 



(2.15) 



Considering again the case pi = 0, we have 

Di=D = 1/2 F, = -l + 27r« 

and the following form for the current: 



J. 



h3 



-iPi- 



(1 - ni)Pij 



(2.16) 



(2.17) 



which is nothing but the probability flux from state i — 1 to state i. 

The relation between the external potential Vi and the games probabilities is in 
this formulation written as: 



Vi 



1 1 

k=i 



1 + Ffc-i 



1 * 

fe=i 



TTfc-l 



1 



TTfe 



(2.18) 



where the value Vb = has been adopted for convenience. This equation is the 
main result concerning the relation between the games probabilities 7Tj and the dis- 
cretized version of the potential Vi. As with (2.10), through (2.18) we can obtain 
the potential that corresponds to a Parrondo game. Notice that both approaches 
yield different values for the potential Vi corresponding to a set of games probabil- 
ities {ir , . . . ,ttm-i}- For instance, in the case of a fair game, the potential given 
by (2.18) is a periodic function V*+m = Vi, (Toral et al. 2003b). Nevertheless, it 
can be shown that both potentials coincide in the limit of an infinitessimaly small 
space discretized step A. 

It is possible to solve the master equation (2.11) using a constant current 
Jij = J, together with the boundary condition Pf* = P£+ M in order to obtain 
the stationary probability distribution Pf. The result is: 



Ne 



-2V t 



N ■f-f 1 — Fj 

3 = 1 J 



with a current 



-2Vm 



J = N 



c ; 

z Z^=i i- 



(2.19) 



(2.20) 



and N is a normalization constant obtained from X^fcLo 1 = 

The inverse problem of obtaining the game probabilities in terms of the potential 
can also be done. It requires solving (2.18) with the boundary condition F — Fm- 
The solution is given by 



Fi = (-1)^ 



(_l)M e 2(Vo-V M ) _ 1 + 



3=1 



(2.21) 
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which, via tt, = (1 + -Fj)/2, allows one to obtain the probabilities 7Tj in terms of the 
potential Vi. It is clear that the additional condition m E [0, 1], Vi must be fulfilled 
by any acceptable solution. 

To sum up, we have two approaches, either (2.10) or (2.18), that allow one to 
obtain the potential corresponding to a set of probabilities (7r , . . . , ttm-i) defining 
a Parrondo game. In both approaches it is very easy to introduce self-probabilities 
Pi ^ 0. Therefore, we find it interesting to investigate the effect of these terms in 
the Parrondo's paradox. Therefore we introduce a new branch in the original games 
(Harmer & Abbott 2002) that accounts for the self-transition probability denoted 
by r*j. The new diagrams for the games A and B are presented in figure 1. In the 
next section we will investigate the effect of this new inclusion upon the Parrondo 
effect. 



Figure 1. Probability trees of the new games A and B. Game A is formed by three branches, 
denoting the three possibilities of winning ( W) , remaining in the same state (R) and losing 
(L). Note that game B has a capital dependent rule and therefore is not a martingale. 

3. Analysis of the new Parrondo games with self-transitions 

(a) Game A 

We start with the new game A, where the probability of winning is p, the 
probability of remaining with the same capital will be denoted as r, and we lose 
with probability q = 1 — r — p . 

Following the same reasoning as Harmer et al. (2000) we will calculate the 
probability fj that our capital reaches zero in a finite number of plays, supposing 
that initially we have a given capital of j units. From Markov chain analysis (Karlin 
1973) we have that 

• fj = l for all j > 0, and so the game is either fair or losing; or 

• fj<l for all j > 0, in which case the game can be winning because there is 
a certain probability that our capital can grow indefinitely. 

We are looking for the set of numbers {fj} that correspond to the minimal 
non-negative solution of the equation 
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fj =P- fj+i+r ■ fj + q- fj-i, i>l (3.1) 
with the boundary condition 

/o = 1 ■ (3.2) 
With a subtle rearrangement, (3.1) can be put in the following form 

h rV/^ ' vh-' L ■ (3 - 3) 

Whose solution, for the initial condition (3.2), is fj=A- [( l p p r V — 1] + 1 5 where 
A is a constant. For the minimal non-negative solution we obtain 



fj = min 



1, 



1 - p - r x 



So we can see that the new game A is a winning game for 

1 — p — r 



(3.4) 



is a losing game for 
and is a fair game for 



P 

1 — p — r 
P 

1 — p — r 
P 



< 1, (3.5) 

> 1, (3.6) 
= 1. (3.7) 



(b) Game B 

We now analyze the new game B. Like game A, we have introduced the proba- 
bilities of a self-transition in each state, that is, if the capital is a multiple of three 
we have a probability n of remaining in the same state, whereas if the capital is 
not a multiple of three then the probability is r 2 . The rest of the probabilities will 
follow the same notation as in the original game B, so we have the following scheme 



mod(capital, 3) = — * px, n , qi 

(3.8) 

mod(capital, 3) ^ — > p 2 , r 2 , <?2- 



As in the case of game A, we will follow similar reasoning as Harmcr et al. 
(2000) but for game B. Let gj be the probability that the capital will reach the ze- 
roth state in a finite number of plays, supposing an initial capital of j units. Again, 
from Markov chain theory we have 



• gj = 1 for all j > 0, so game B is either fair or losing; or 
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• gj < 1 for all j > 0, in which case game B can be winning because there is a 
certain probability for the capital to grow indefinitely. 

For j > 1, the following set of recurrence equations must be solved: 

93j = Pi ■ .93.7+1 + ri • g 3j + (1 - pi - n) • .93.7-1, j > 1 

.93j+i = P2 ■ #3.7+2 + r 2 ■ gzj+i + {1-P2~ r 2 ) ■ g 3] , j > (3.9) 

93J+2 = P2 ■ 53.,+3 + r 2 ■ g 3j +2 + (1-P2- ^2) • 53j + l, J > . 

As in game A, we are looking for the set of numbers {gj} that correspond to the 
minimal non-negative solution. Eliminating terms g 3 j-i, g 3 j+i and g 3 j+2 from (3.9) 
we get 

[PiP2 + ( 1 -Pi- r i)( 1 -P2-r 2 ) 2 }-g 3l = p 1 pl-g 3l+3 + (l-p 1 -r 1 )(l-p 2 -r 2 ) 2 -g 3j - 3 . 

(3.10) 

Considering the same boundary condition as in game A, g a = 1, the last equa- 



tion has a general solution of the form g 3 j = B 



f (l-pi-ri)(l-P2-r 2 ) 2 y _ 1 



where B is a constant. For the minimal non-negative solution we obtain 

(1-pi -ri)(l -p 2 -r 2 ) 2x ; 



+ 1, 



93j 



1, 



P\P\ 



(3.11) 



It can be verified that the same solution (3.11) will be obtained solving (3.9) 
for g 3 j+i and g 3 j+ 2 , leading all them to the same condition for the probabilities of 
the games. 

As with game A, game B will be winning if 



losing if 



and fair if 



(1 


-Pi 


-ri)(l- 


P2 


-r 2 f 






Pipl 






(1 


-Pi 


-ri)(l- 


P2 


-r 2 f 






P\p\ 






(1 


-Pi 


-ri)(l- 


P2 


-r 2 f 


P\p\ 



< 1, (3.12) 

> 1, (3.13) 
= 1. (3.14) 



(c) Game AB 

Now we will turn to the random alternation of games A and B with probability 
7. This will be named as game AB. For this game AB we have the following (primed) 
probabilities 

• if the capital is a multiple of three 

pi=7-P+(l-7)-Pi, (3 . 15) 
r[ = 7 • r + (1 - 7) • ri, 
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• if the capital is not multiple of three 

v'i = 7 -P+ (1 -7) -P2, 



(3.16) 

r 2 = 7 • r + (1 - 7) • V2- 

The same reasoning as with game B can be made but with the new probabilities 
Pi, r[, p' 2 , r 2 instead of pi, n, P2, r 2 . Eventually we obtain that game AB will be 
winning if 

(3.17) 



losing if 

> 1, (3.18) 



and fair if 



(1 


-Pi 


-ri)(l- 


P2 








p'iP'2 






(1 


-Pi 


-ri)(l- 


P2 


-r 2 ) 2 






P1P2 






(1 


-Pi 


-ri)(l- 


P2 





5? L (3 ' 19) 



The paradox will be present if games A and B are losing, while game AB is 
winning. In this framework this means that the conditions (3.6), (3.13) and (3.17) 
must be satisfied simultaneously. In order to obtain sets of probabilities fulfilling 
theses conditions we have first obtained sets of probabilities yielding fair A and B 
games but such that AB is a winning game, and then introducing a small biasing 
parameter e making game A and game B losing games, but still keeping a win- 
ning AB game. As an example, we give some sets of probabilities that fulfill these 
conditions: 

(a) p =2%-e, r = ±, 

(&) P =2%- e ' r = To> 

(c) P =35-e, r = ±, 

(d) P =\~ e ' r = h 



Pi = 
Pi = 


100 c ' 
509 

5000 fc > 


fl = 

r-i = 


Pi = 


-e 

25 ' 


ri = 


Pi = 


25 c ' 


n = 



J_ 

10' 

J_ 

10' 
2 



P2 = 


3 
5 


' ■ 


- 2 = i 


P2 = 


7 

10 


- e, 


r 2 = M 


P2 = 


3 _ 


e, 


r 2 = 15 


P2 = 


5 


e, 


r 2 = 15 
(3.20) 



4. Properties of the Games 

(a) i?afe of winning 

If we consider the capital of a player at play number n, X n modulo M, we 
can perform a Discrete Time Markov Chain (DTMC) analysis of the games with a 
state-space {0, 1, . . . , M — 1} (c.f. Harmer et al. 2001). For the case of Parrondo's 
games we have M — 3, so the following set of difference equations for the probability 
distribution can be obtained (Lee et al. 2002b): 

Po,n+l = P2 ■ P2,n + Tl ■ P ,n + 92 ' Pl,n 

Pl.n+1 = Pi ■ P ,n + T 2 ■ Pl.n + q2 ■ P2,n (4.1) 
^2,71+1 = P2 ' Pl,n + r 2 ■ P2.n + qi ■ Po,n 
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l-il 


(s 









which can be put in a matrix form as P„+i = T • P„, where 

/ n q 2 p 2 \ 
T = I Pi r 2 q 2 ) (4.2) 

\ ?1 P2 

and 

Po.n 

Pl.n | - (4.8) 

In the limiting case where n — > oo the system will tend to a stationary state 
characterized by 

n = t n (4.4) 

where lim^oo P„ = II. 

Solving (4.4) is equivalent to solving an eigenvalue problem. As we are dealing 
with Markov chains, we know that there will be an eigenvalue A = 1 and the rest will 
be under 1 (Karlin 1973). For the A = 1 value we obtain the following eigenvector 
giving the stationary probability distribution in terms of the games' probabilities. 

(1 - r 2 ) 2 -p 2 ■ (1 -P2 - r 2 ) \ 
(l-n)(l-r 2 )-p2-(l-pi-ri) (4.5) 
(1 - n)(l - r 2 ) -pi ■ (1 -p 2 - r 2 ) ) 

where D is a normalization constant given by 

D = (1 - r 2 ) 2 + 2(1 - n)(l - r 2 ) - p 2 (2 -p 2 - r 2 - r\ -p\) -p\(\ -p 2 - r 2 ). (4.6) 

The rate of winning at the n-th step, has the general expression (Harmer et al. 
2001) 

OO 

r(n) = E[X n+1 ] - E[X n ] = i ■ \ P W - Pi,n] ■ (4.7) 

i— — oo 

Using these expressions and by similar techniques to those employed in Harmer et 
al. (2001) it is possible to obtain the stationary rate of winning for the new games 
introduced in the previous section. The results are, for game A: 

r s 2 = 2p + r - 1 (4.8) 

and for game B 

r S B = 2p 2 +r 2 -l + [q 2 -P2+P1- <?i] • n 

= -^iPiPl-(l-Pi-ri)(l-p 2 -r 2 ) 2 ) (4.9) 

where D is given by (4.6). 

It is an easy task to check that when n = r 2 = we recover the known 
expressions for the original games obtained by Harmer et al. (2001). To obtain the 
stationary rate for the randomized game AB we just need to replace in the above 
expression the probabilities from (3.15) and (3.16). 
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Within this context the paradox appears when r s ^ < 0, < and r A * B > 0. If, 
for example, we use the values from (3.20d) and a switching probability 7 = 1/2, 
we obtain the following stationary rates for game A, game B and the random 
combination AB: 



r s l = -2e, 

rg = -'(441 - 120* + 1000^ (4 1Q) 



r AB — 



231 - 40e + 500e 2 
93 - 9828e + 1920e 2 - 32000e 3 
2 (2499 - 320e + 8000e 2 ) 



which yield the desired paradoxical result for small e > 0. 

We can also evaluate the stationary rate of winning when both the probability 
of winning and the self-transition probability for the games vary with a parameter 
e as p = p — I and r = r + e, so that normalization is preserved. Using the set of 
probabilities derived from (3.20d), namely p = \ — | , r = \ + e ,pi — ^ — | , n = 
I + e i = f - § , ^2 = ^7 + e, the result is: 



r2 = 0, 

-e(21-20e) 



AB 



2(77- 200e+ 125e 2 )' 
31 - 164e+ 160e 2 
2 (833 - 2600e + 2000e 2 ) 



(4.11) 



again a paradoxical result. 

A comparison between the expressions for the rates of winning of the original 
Parrondo games (Harmer et al. 2001) and the new games can be done in two 
ways. The first one consists in comparing two games with the same probabilities 
of winning, say original game A with probabilities p = \ and q = \ and the new 
game A with probabilities p DCW = i, r ncw = j and g nC w = \- In this case we can 
think of the 'old' probability of losing q as taking the place of the self-transition 
probability r ncw and the new probability of losing g new - In this way we obtain a 
higher rate of winning in the new game A than in the original game - remember 
that the new game A has an extra term r in the rate of winning compared to the 
original rate, and this extra term is what gives rise to the higher value. The same 
reasoning applies for game B, leading to the same conclusion. 

The other possibility could be to compare the two games with the same proba- 
bility of losing. In this case, we follow the same reasoning as before, but now we can 
imagine the 'old' probability of winning as replacing the winning and self-transition 
probabilities of the new game. What we now obtain is a lower rate of winning for 
the new game compared to the original one. An easy way of checking this is by 
rewriting (4.8) and (4.9) as 

r%=p-q (4.12) 

r S B = -| (P1P2 -QiQl)- 

So for the same value of q but a lower value of p we obtain a lower value for the 
rates of game A and B. 
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Figure 2. Parameter space corresponding to the values r = |, r% = | and r2 = ^j. The 
actual region where the paradox exists is delimited by the plane pi = and the triangular 
region situated at the frontal face, where all the planes intersect. 



We now explore the range of probabilities in which the Parrondo effect takes 
place. We restrict ourselves to the case M = 3 and 7=1/2 used in the previous 
formulae. 

The fact that we have introduced three new probabilities complicates the repre- 
sentation of the parameter space as we have six variables altogether, two variables 
{p, r} from game A and four variables {p±, ri,p2, ^2} coming from game B. In order 
to simplify this high number of variables, some probabilities must be set so that 
a representation in three dimensions will be possible. In our case we will fix the 
variables {r,r 1^2} so that the surfaces can be represented in the parameter space 

{P,Pl,P2}- 

In figure 2 we can see the resulting region where the paradox exists for the 
variables r = j , r\ = g and r-2 = jq. Some animations have shown that the volume 
where the paradox takes place, gradually shrinks to zero as the variables r, r\ and 
T2 increase from zero to their maximum value of one. 

Another interesting fact that we have encountered, which remains an open ques- 
tion, is the impossibility of obtaining the equivalent parameter space to figure 2 with 
the fixed variables p, p\ , P2 and with the parameter space variables r, r\ , T2 instead 
- it is possible to obtain the planes for games A and B, but not for the randomized 
game AB. 
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Figure 3. Average gain as a function of the number of games played coming from numerical 
simulation of Parrondo's games with differet sets of probabilities. The notation [a, b] indi- 
cates that game A was played a times and game B b times. The gains were averaged over 
50 000 realizations of the games, a) Simulation corresponding to the probabilities (3.20a) 
and e = b) probabilities (3.20b) and e = c) probabilities (3.20c) and e = —575; d) 
probabilities (3.20d) and e = ■ 

(6) Simulations and discussion 

We have analyzed the new games A and B, and obtained the conditions in order 
to reproduce the Parrondo effect. We now present some simulations to verify that 
the paradox is present for a different range of probabilities - see figure 3. Some 
interesting features can be observed from these graphs. First it can be noticed that 
the performance of random or deterministic alternation of the games drastically 
changes with the parameters. 

We use the notation [a, b] to indicate that game A was played a times and game 
B b times. The performance of the deterministic alternations [3, 2] and [2, 2] remain 
close to one another, as can be seen in figure 3. However the alternation [4,4] has 
a low rate of winning because as we play each game four times, that causes the 
dynamics of games A and B to dominate over the dynamic of alternation, thereby 
considerably reducing the gain. 

The performance of the random alternation is more variable, obtaining in some 
cases a greater gain than in the deterministic cases - see figure 3c. 
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Figure 4. Comparison of the theoretical rates of winning - dashed lines - together with 
the rates obtained through simulations - solid lines. All the simulations were obtained 
by averaging over 50 000 trials and over all possible initial conditions, a) The parameters 
correspond to the ones used in equations (4.10). b) The parameters correspond to the ones 
used in equations (4.11). 




Figure 5. Comparison between the theoretical and the simulation for the gain vs gamma, 
for the following set of probabilities :p=i,r=|;pi = ^, ri = | and p2 = §, ri = jg. 
The simulations were carried out by averaging over 50 000 trials and all possible initial 
conditions. 

In figures (4a) and (4b) a comparison between the theoretical rates of winning 
for games A, B and AB given by (4.10) and (4.11) and the rates obtained through 
simulations is presented. It is worth noting the good agreement between both re- 
sults. 

It is also interesting to see how evolves the average gain obtained from the 
random alternation of game A and game B when varying the mixing parameter 
7. In figure 5 we compare both the experimental and theoretical curves. As in the 
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original games, the maximum gain is obtained for a value around 7^5 (Lee et al. 
2002b). 

5. Conclusion 

We have reviewed how the derivation of Parrondo's games from the flashing Brow- 
nian ratchet can be rigorously established via the Fokker-Planck equation. This 
procedure reveals new Parrondo games, of which the original Parrondo games are 
a special case with self-transitions set to zero. This confirms Parrondo's original 
intuition based on a flashing ratchet is correct with rigour. We interpreted the self- 
transitions in terms of particles, in the flashing ratchet, that remain stationary in 
a given cycle. We then presented a new DTMC analysis for the new games show- 
ing that Parrondo's paradox still occurs if the appropriate conditions are fulfilled. 
New expressions for the rates of winning have been obtained, with the result that 
within certain conditions a higher rate of winning than in the original games can be 
obtained. We have also studied how the parameter space where the paradox exists 
changes with the self-transition variables, and conclude that the parameter space 
corresponding to the original Parrondo's games is a limiting case of the maximum 
volume - as the self-transition probabilities increase in value the volume shrinks to 
zero. However, it is worth noting that despite the volume decreases with increas- 
ing the self-transition probabilities, the rates of winning that can be obtained are 
higher than in the original Parrondo's games. 

This work was supported by GTECH Australasia; the Ministerio de Ciencia y Tecnologi'a 
(Spain) and FEDER, projects BFM2001-0341-C02-01 and BFM2000-1108; P.A. acknowledges sup- 
port form the Govern Balear, Spain. 
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